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Abstract 

The numerical scheme based on the Legendre-tau approximation is proposed 
to approximate the feedback solution to the linear quadratic optimal control 
problem for hereditary differential systems* The convergence property is 
established using Trotter ideas. The method yields very good approximations 
at low orders and provides an approximation technique for computing closed- 
loop eigenvalues of the feedback system. A comparison with existing methods 
(based on "averaging" and "spline" approximations) is made. 
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INTRODUCTION 


This paper is the continuation of the study [9] on the use of Legendre-tau 
approximation for functional differential equations (FDE) and concerns the 
problem of constructing feedback solutions to linear quadratic regulator 
problems for hereditary systems* This problem has received a rather extensive 
study and we refer to [14], [2] and [4] for the summary of the earlier 
contributions. Our approach is based upon the pioneering work of Banks — 
Burns [2] who clarified the idea of approximating FDE by systems of finite 
dimensional ordinary differential equations and applied it to optimal control 
problems; i.e., the convergence of a particular numerical scheme (so-called 
"'averaging - ' approximation) is established, using the Trotter-Kato theorem of 
linear semigroups. Recently, Gibson [8] has developed the approximation 
theory for the Riccati equations associated with a hereditary system and 
applied it to the averaging approximation scheme. 

The purposes of this paper are: (i) to apply the basic idea developed in 
[9] to the linear quadratic regulator problem, (ii) to prove convergence of 
numerical approximations of the feedback control laws and, (iii) to 
demonstrate the feasibility of our numerical schemes. 

For the multiple point delay case, the solution to the algebraic Riccati 
equation (ARE) has jump discontinuities as shown in [8]. With this 
consideration, an extended version of the scheme described in [9] is developed 
for such a case in Section 3. As pointed out in [9] and will be discussed in 
Sections 3 and 5, the tau approximation differs from the standard Galerkin 
approximation and because of this, the theory developed in [8] needs to be 
modified to prove convergence of approximate solutions to ARE. 
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An important question that arose in [8] was concerned with the preserva- 
tion of exponential stability under approximation (i,e., conjecture 7.1 in 
[8]). At this time, we have not been able to answer this question for the 
Legendre-tau approximation* However, some of the numerical computations for 
several examples indicate that the conjecture holds for the tau approximation* 
Moreover, the related property (i*e., the uniform boundedness of approximate 
solutions to ARE) is proved for certain special cases in Lemma 5.4. The other 
discussion contained in [8] is to argue the strong convergence of approximate 
solutions to ARE. Under the same condition as given in Lemma 5.4, one can 
prove it for the tau approximation. However, instead of arguing this, we 
state a rather interesting result in Theorem 5.1. It says that if a sequence 
of approximate solutions to ARE converges weakly to the solution to ARE, then 
the closed loop system which results from the approximate feedback control law 
is exponentially stable for sufficiently large orders of approximation. 

As will be discussed in Section 6, the tau method may offer considerable 
improvements over other methods (e.g. , those discussed in [4], [8]) and it 
gives a good approximation to the closed loop eigenvalue. 

The following is a brief summary of the contents of this paper. In 
Section 2 we review the equivalence results between FDE and abstract Cauchy 
problems on the product space I? x L^ and results on the regulator problem 
for hereditary differential systems. In Section 3 we introduce the numerical 
scheme based on the Legendre-tau approximation for the multiple point delay 
case and the basic convergence of approximate semigroups using the Trotter- 
Kato theorem. In Section 4 we show how one can use the numerical scheme 
described in Section 3 to obtain the feedback solutions. In Section 5 we 
state the basic convergence property of approximate solutions to ARE. 
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Finally, in Section 6 we present numerical results and compare these results 
for those obtained by other methods [4], [8]). 

Throughout this paper the following notation will be used, r > 0 stands 
for the largest delay time appearing in the FDE. The Hilbert space of Un- 
valued square integrable functions on the interval [a,b] is denoted by 
L 2 ( [a,b] ; I?) . When the underlying space and interval can be understood from 
the context, we will abbreviate the notation and simply write L^, 

L 2 ° c ( [O, 00 ); I?) , or L 2 ° c , is the space of ^-valued locally square integrable 
functions on the semi— inf ini te interval [ 0 , 00 ) . is the Sobolev space of 

iP-valued functions f on a compact interval with f(k-l) absolutely 

(k) 

continuous and f e L„ . We denote by Z the product space 

Hf 1 x L 2 ([-r,0];lf l ). Given an element z e Z, n £ and <{> e denote the 
two coordinates of z : z = (n,4>)* The bracket stands for the inner 

product in the Hilbert space H, and the subscript for the underlying Hilbert 
space will be omitted when understood from the context* li*H denotes the norm 
for elements of a Banach space and for operators between Banach space, while 
|* | denote the Euclidean norm in if 1 * 

If X and Y are Banach spaces, then the space of bounded operators from 
X to Y is denoted by L (X, Y)* 19(A) denotes the domain of a linear 

operator A* Xj denotes the characteristic function of the interval I. 

Fianlly, for any function <j> of independent variable 0, we shall use or 

g 

<f> to denote the derivative of (j> with respect to 0. 


T 
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2. RICCATI EQUATIONS 

In this section, we state the type of problems to be considered and recall 
some results on the linear quadratic regulator problem for hereditary 
differential systems. 

Given e Z and u e L 2 ° C ( [0,~) , if 1 ), we consider the initial value 

problem 

d 0 

x(t) = / du(6) x(t + 0) + Bu(t) , (2.1) 

-r 

x(0) = n, x(0) = 4>(0 ) , 0 e [-r ,0) , 

where y is a matrix-valued function of bounded variation on [-r,0] with 
the form 

% 0 

U(9) = l A X/ fl nl (9) +/ A(s)ds (2.2) 

i=0 1 i’ UJ - r 

with 0 = 9 q < < *•* < 9^ = r. and A(») are mxn matrices, the 

elements of the latter being square integrable on [-r,0]. Alternatively, for 
t > 0 

0 Z 0 

/ du(0)x(t + 0) = l A x(t - 0.) + / A(0)x(t + 0)d0. 

-r i=0 -r 

It is well known [2], [5], [6] that for (n,<f>) e Z and u e L 2 ° c , (2.1) 
admits a unique solution x e L 2 ( [-r,T] ; if 1 ) 0 H 1 ([0,T];lP) for any T > 0, 
and that (2.1) can be formulated as an evolution equation on Z 

^ z(t) = Az(t) + Bu(t), t > 0 (2.3) 

where z(t) = (x(t), x(t + •)) e Z, t > 0 and u = (Bu,0) e Z for 
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u e IP. The infinitesimal generator A is defined by 


V(A) = {(n,<f>) e z I n - *<0) and $ e h^\ (2.4) 


and for (4> (0 ) »4> ) e P(A) 


0 

A(*(0),*) = ( j dy ( 0 )4> ( 0 ) ,$) . 

-r 


(2.5) 


The CQ-semigroup generated by A on Z will be denoted by { S( t ) t > 0}. 

Consider the optimal control problem on a finite interval [0,1] : for 
given initial (ti,<|>) e Z, 

T 

minimize J(u;[0,T]) = / (|Cx(t)|^ + |u(t)|^)dt + |Rx(T)|^, (2.6) 

0 

over ue L^( [0,T] ; tf 1 ) subject to (2.1). Here C and R are p*n 
matrices. Within the framework of (2.3), (2.6) can be written as 

T 

j(u) = / (|Cz(t)| 2 + |u(t) l 2 )dt + |Rz(T) | 2 

0 

where C (n ,cf> ) = Cp and R (n ,<f> ) = Rti for e Z. It then follows from 

[1], [7] that the optimal solution u® to (2.6) is given by 


u°(t) = -B* II(t)z 0 (t), t > 0 


(2.7) 


where n(«) is the unique solution, within class of non-negative (definite) 
self-adjoint operators for which <II(t)z,z> is absolutely continuous on 
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[0,T], of the Riccati equation 


<n(t)z,z> = -2<Az,n(t)z> + < 8* n(t)z, 8* n(t)z> - <Cz,Cz> 


for all z e P(A) (2.8) 


n(T) = R R , 


and z u (t) satisfies the evolution equation 


77 z°(t) = ( A - 8* 8n(t)) z°(t), t > 0 


(2.9) 


z (0) = (n,<(»). 


Now we consider the optimal control problem on the infinite interval. For 
given initial data z = (n,<f>), minimize the cost functional 


J(u,z) = / ( |Cz(t ) | 2 + |u(t)| 2 )dt, 

0 


( 2 . 10 ) 


subject to (2.3). 


Definition 2.1. 


(i) (A ,8) is stabilizable if there exists a bounded operator K such 
that A ~ 8 K generates a uniformly exponentially stable semigroup. 


(ii) (C,A) is detectable if (A*> C*) is stabilizable. 
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Remark 2.2. For hereditary differential systems, the condition (ii) is 
equivalent to 

z e V(A ), Az = Xz and Cz = 0 
for X e <D + imply that z = 0. Moreover, (ii) holds if 


rank[A(X)^, C^] = n for all X e <E + 


0 


where A(X) = XI - / dp(0)e^. 

-r 


An operator II e L(Z) is a solution of the algebraic Riccati equation 
(ARE) if 

2<Az,nz> - <8* n z , 8* n z > + <Cz,Cz> = 0 


for all z e p(A). 


(ARE) 


The next theorem follows from [7], [17]. 

Theorem 2.3. 

(i) _If_ (A ,8) is stabilizable, then (ARE) has a self-adjoint, non- 
negative solution. 

(ii) _If_ (C>A) is detectable, then (ARE) has at most, one self-adjoint, 
non-negative solution. Moreover, if II denotes the said solution, 
then A “ 88 n generates a uniformly exponentially stable 


T 


semigroup . 
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(iii) JLf_ (A>8) Is stabillzable and (C,A) is detectable, then (ARE) has 
a unique self-adjoint, non-negative solution and the optimal control 
to (2.10) is given by 

u°(t) = - 8* nz°(t), (2.11) 

where z^(t) is the mild solution to 


^ z°(t) = (A - 88* n)z°(t) 
z^(0) = z. 

In what follows, we assume that condition (iii) in Theorem 2.3 holds and 
recall some of the important results due to Gibson [8]. 

Theorem 2.4. If II Is the self-adjoint, non-negative solution to (ARE), 

then 

n Z c p(A*). 


yc 

Note that V(A ) consists of elements (y,j>) e Z for which 
^ T 

z(0) - 1|K0) - I X(_g QJ y is absolutely continuous on [-r,0] with 
z(-r) = 0, [16]. If we write II as a matrix of operators on Z = if 1 x I^J 


n = 


00 

n 01 ' 

10 

n 11 . 


( 2 . 12 ) 
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where is a non-negative, symmetric nxn matrix, II^(») is a 

integrable matrix function on [-r,0], «* and 


n 01 <t> = / n lu ( 9 ) x <K 9 )de, <t> e l 2 . 


rlO/rtvT 


-r 


.11 


and II is a non-negative, self-adjoint operator on L^, then from 
the optimal control u® may be written as 


u u (t) = -B T (n 00 x(t) + / n iU ( 6 ) x x(t+9)d0) 


10 /oN T 


-r 


From Theorem 2*4 we have 


r 1 0 


Theorem 2*5. II (•) is piecewise absolutely continuous on [-r,0] 


the jump conditions at -0^, 1 < i < £-1 


n lo ((- 0 i ) + ) - n 10 ((- 9 i )") = aJ n 00 . 


Also, 


„10, . .T ,.00 

n (-r) = a^ n . 


Let us define an operator on ZxZ 


r A 


H = 


-BE 


ie 

K -i 


-C*C -A* 


square 


( 2 . 11 ) 


with 



Theorem 2.6 


ft is closed and densely defined and has compact 


resolvent. For a complex number X with Re X < 0, 

X e a (A -88*11) If X e a (H). 

The algebraic and geometric multiplicities of X as an eigenvalue of 
* 

A “ BB n are finite and are identical to the respective multiplicities of 
X as an eigenvalue of ft . Moreover , X is an eigenvalue of ft if 

A 

det A(X) = 0 where 


0 

/ dy(9) e 

-r 


X0 


A(X ) = XI - 


T 

-C C 


-BB 


f j -xT X0 
J dy(0) e 

-r 


3. LEGENDRE— TAU APPROXIMATIONS 

As pointed out in Section 2, for the multiple point delay case, 
has jump discontinuities. If we were to try to approximate the solution to 
n 10 (* ) using a series of polynomials on [-r,0], we would observe the so- 
called Gibbs phenomena. To avoid this difficulty, we proceed as follows. For 
simplicity of exposition we deal with the system of the form; 
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^-x(t) = A q x(t) + Aj x(t + (-0 1 > + ) + A 2 x(t - 0 2 > 


+ / A(9) x(t + 0)d0 + Bu(t), (3.1) 


— r 


with -r = -0 2 <-0 1 <O. 

Alternatively, if z(t,0) = x(t + 0), then 


fjr z(t,9) - f^r z(t,0), 


-r < 0 < 0 


(3.1a) 


z(t,0) = A q z(t,0) + Aj z(t,-0 1 ) + A 2 z(t ,-r) + / A(0) z(t,0) + Bu(t). 

-r 

(3.1b) 


The approximate solution 


z N (t,0) 


is assumed to be represented as 


zN(t,0> ' Jo P “ ,<e >*<-V0> <9> + Jo bk p “ )(6>x [-.-» 1 ] (e) ’ (3 - 2) 


where 

p k 1)(9) = p k ( (20 + e i )/ 0 i)» 

P k 2)(0) = P J (29 + 9 1 ) + ®2 " 0 l) / ( 0 2 ” V)’ 


for 0 < k < N and are t * ie k®S® n dre polynomials on [-1,1]. Note 

N —1 

that (3/80)z is given by the following as an element in H“. 
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where A l = 9 i> A 2 = 6 2 " 0 1» and is the delta function. The 
underlying ideas of the tau method for approximating (3.1) are: (i) equating 
(3.1a) in the sense that 


<lt zN<t * e) £ >l 2 * 0 


(3.3) 


for all 


f £ (£ E L | f 


N— 1 

- I 

k=0 


„ ( 1 ) 

“k p k 


N (2) 

x (-e i ,0] + k A 0 e k p k X [-r,-0 1 ] ,Ct k ,B k £ 


and (ii) imposing (3.1b) on the approximate solution z N (t,0). From (i) we 
obtain (2N+1) equations; 


'St vt) - < 2/ v (sa > k ’ 


0 < k < N-l 


N 


(3.4) 


1^- b k (t) = (2/A 2 ) (Sb) k + J ((-l) 1 a ± - b i )(2k+l)/A 2 , 0 < k < N . 


where S is the matrix representation of the derivative 9/30 (i.e., if the 

vector a is associated with a series of Legendre polynomials whose 
coefficients are the components of a, then the components of Sa give the 
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Legendre coefficients of the derived series), and is given by 


S = 


0 

0 

0 


0 

0 


1 

0 

0 


0 

0 


0 

3 

0 


0 

0 


1 

0 

5 


0 

0 


0 

3 

0 


0 

0 


I • • 
> • • 


I • • 
I • • 


1 

0 

5 


2N-3 

0 


0 

3 

0 


0 

2N-1 


© 


I (3.5) 


for N even. Here I is the nxn identity matrix and © denotes Kronecker 
product. From (ii) we obtain an equation for ajj, i.e.. 


d 

dt 


N ° „ 

( l a. (t)) = / du(0)z N (t,0) + Bu(t) 

k=0 -r 


or 


d 

dt 


N-i . 0 N 

a N (t) = - l a fc (t) + / dp(0) z (t,0) + Bu(t), 

k=0 -r 


(3.6) 


Hence, from (3.4) and (3.6) we obtain a system of ordinary differential 
equations for col( b Q ,• • • ,b N ,a Q ,• • • ,a N ) : 


d_ 

dt 


V 


i 

S5 

ca 

c 

N 

a 

= A 

N 
, a 


+ B N u(t) 


(3.7) 


B "- (c 2N+2 © I)B - 


N N 

where a = col ( sq^ ,• • • ,a N ) , 0 = col(bQ,b 1 , • • • ,b N ) and 
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e 2N+l = ,1) e if W e define the matrices j(^) and 

S by 

^ N + i x 

= [u, u, ••• ,u] (£) I 


J 


( 2 ) 




I 


with u = col(l,3,*«» ,2N+1) and, 


S 


(0 -1, -3, 


S 


-NC|U1) Q , 


» 


then is given by A^ = Aq + A^ where, 


a"- 


-A (2S - J (l) ) 


© 


and 


a n - 


0 

© 


F • • • j? 

0 *N 


AT j(2) 1 



© - 
© 
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wit h 


0 


\ = ( A o + (_1)K V + / A<0) Pk 1)(0)de 

“ 6 1 


and 


- 0 , 


F, = (-1) K A_ + / A(8) p^ 2) (0)d0, for 0 < k < N 


-r 


Note that in the case when 0 1 = r, the approximation scheme described 
above for (3.1) is exactly the same as that given in [9]. Let us introduce 

U JiJ 

the orthogonal projection Q w on Z. For any z = (p,<j>), Q is defined by 


Q N Z = 


a k Pk^^H^.O] + J Q b k Pk^^^hr.-Oj]^ 


where 


\ = f 1 < t , < 0 )Pk 2)(0)d0 ’ 


0 < k < N, 


(3.8) 


= “r— / 4>(9)p^ 1) (0)d0, 0 < k < N-l, 


k A 


1 - 9 , 


(3.9) 


and, we define the projection operator on Z by 


L N z - q" z + a N (0, p< U X ( _J 1>0I ) 


m N-l /• . \ N-l 

i = n - I a. p k (0) = n - l 
k=0 k=0 


(3.10) 


Immediately, one can obtain the following lemma. 


[ 
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Lemma 3.1 If (ri,<j>) = z, then <f>(0) = h. For N > 1, 


t N _N t N . _N t N a N 
L Q = L and Q L = Q . 


Moreover, if 


^ Z k=0 ^k^ 0 *’ P k° X (-6 1 ,0]^ + V°» p k } X [-r,-0 1 ]- 


and 


Q N z = 


Jo a k (0 ’ P k U X (-9 1 ,0]) + " a *CD> + \(°> Pfc 2> Xl-r.Sj 


then we have 


( b 0»***» b N » a 0’*** ,a N-r a N^ ^ b 0’*** ,b N ,a 0’***’ a N-l ,T1 ^ 


where 


_N 

n = 




© 


I i i ••• i 


As shown in [9], the tau method can be interpreted as follows. Let 


z N (t.O) e Z 


(3.11) 


z N (t) = (z N (t,0), 


(3.12) 
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where z N (t,*) is given by (3.2). Then z N (t), t > 0 satisfies 


If *"<'> 


L N Az N + L N Bu(t) 


(3.13) 


z N (0) 


t N 

L z . 


From (3.11), the approximating solution 


z N (t) = Q N z N (t), t > 0 


(3.14) 


satisfies 


z N (t) = A N z N (t) + Bu(t) 


(3.15) 


z (0) = Q z. 


where 


a n - 


q n al". 


The following lemma concerns the question of stability of the tau 
approximation for (3.1). Following an idea in [2], we define the norm II II 

O 

on Z by 

7 0 2 

n zii ■ |n| + / |<f>| g(0)de for z = (n,<f>) £ z, 

g -r 

where g is the piecewise constant function on [-r,0] defined by 


g(9) 



0 e [-r.-op 

0 e (-0J.O] 


(3.16) 
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Lemma 3.2. Let {S N (t), t > 0} be the semigroup on generated by 

A 1 * = Q^AL^. Then there exists a positive constant 10 such that 


S N (t)ll < e 106 , t > 0. 

g 


Proof : Let us consider the inner product <•,•> on 


<(n 1 ,<J> 1 ),(n 2 ,<(> 2 )> = <n 1 ,n 2 > - + / g(e)de. 

o R K 1 


It suffices to show that A N - u>I is dissipative on Z with the norm 


B • H ; i.e., for all z e Z, 

s 


<A^ z, z> < uiizH 2 . 

g g 


<n,+ ) - L N Z - (n, a* p< 1> x ( .e i>0J + j o \ p< 2> X[- r> - 9 i j). 


where a^, b^ are given by (3.8) - (3.10) and let (n,?) = Q N z. Since p N 
is orthogonal to all polynomials of degree at most N-l, it follows from 
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(3.4), (3.6), and (3.7) that 


<A z, z> = </ dy (e)4>(9), n> + / 4(9),<K0)>d6 


0 N N 

+ 2 / 4(0),<K0)>d0 + < l ((-l) 1 a. - b.) I b.>. (3.18) 

-0J i=0 k=0 


Note that 


N N 

<K0) -n, 4>( (—0 , )") = l b and ♦((-e,) + ) = l (-1)*" a, 

k=0 k=0 


Then the right-hand side of (3.18) becomes 


= </ du (0)< j >(0),< KO )> + — ( |< f >((-0 )”| 2 - | K - r )| 2 ) + | < K 0) | 2 - 1 (— 0 ) + )| 2 

2 1 1 

+ <$((-0 1 ) + ) .♦((-Qj) )> - 1 4>( (— ) )| 2 

+ 0 

= <A q <(>(0) + 4>( (-Oj) ) + A 2 <K-r) + / A(0H(0)d0,*(O)> 

“IT 

" 7 lM-r)| 2 -i |4>(<-0 1 ) + ) - ^((-O^")! 2 1 4>c (-©! > + ) 1 2 + |4>(0)| 2 

< (1 + |A 0 | + j |aJ Aj + y|A 2 A 2 |) |<K0)| 2 


[ 
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+ (/ | A(6 ) | 2 d0) 1/2 (/ |?(0)| 2 d9) 1/2 |<J>C0>| 

-r -r 

< o)Hq n zii 2 < ion zii 2 , 
g g ’ 

where 

0) = i + |a q | + i |Aj Aj + I |A* A 2 | + | 1A(.)» l , 

2 2 

and we used the relation: 2<x,y> < |x| + |y| for x,y e if 1 , and the fact 

the Q N is symmetric w.r.t. <•»•> - inner product. (Q.E.D) 

To establish convergence for the tau approximation, we will use the 
Trotter-Kato theorem (see Theorem 4.6 in [10]). 

N 

Theorem 3.3. Let S(t) and S (t), N > 1 be Cp — semigroups acting on a 
Banach space X with infinitesimal generators A and respectively. 

Assume that the following conditions are satisfied : 

(i) (stability). There exists a constant 10 such that 


tot 


and 


ns N (t)n, 


< e 


0)t 


«S(t)I x < e 


t > 0 
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(ii) (consistency). There exists a subset 09 contained in 
00 

V(A) H 0 V(A^) which together with (XI - A) for some X > 0 is dense 
in X and such that A <|> — A for all <f> £ V £s N -► ». 

Then for all 4> e X, 

HS N (t)<j> - S(t )<f>!I -*■ 0, 
uniformly on bounded t-intervals. 


In our discussions X is the Hilbert space Z equipped with the inner 
product (3.17). We will prove the consistency of the tau approximation in 
Section 5 (see Lemma 5.2). 

Remark l Although we will not pursue the details here, one can prove that 
the adjoint semi -groups S^(t) also converge strongly to S (t) uniformly on 
bounded t-intervals. 


4. AN APPROXIMATION SCHEME FOR THE RICCATI EQUATION 

In this section, we discuss an approximation scheme for the regulator 
problem (2.10) based upon the Legendre-tau approximation. 

Let us consider the Nth approximate problem to (2.10) 

00 

Minimize J^(u,z) = / (| Cz^(t)|^ + |u(t)|^ dt, (4.1) 

0 


subject to (3.15): 
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d ~N/_\ iN ~N, v n N 
■££ z (t) « A z (t) +8 u(t), 


z^(0) = z = z. 


It follows from Theorem 2.3 that if (A 1 ^, 8) is stabilizable and ( 


N 


detectable, then there exists a unique solution II" to (ARE)**: 


(A n )* n N + n N a n - n N 88* n N + c*c = 0, 


and the optimal solution to (4.1) is given by 


u N (t) = -8* n N z N (t) 


~N 

where z (t), t > 0 satisfies 


d ~N, * 
dF Z (t) 


N * N ~N 

(A -88 n )z (t) 


z N (0) 


= z , 


In terms of the Legendre coordinate system, 


* N(t > ' Jo a *‘ (t)to ’ p ” > x <-e 1 .0] ) 


+ © ) + I b k (t)(0, p[ 2) X r__ _ 0 ,) 

k=0 K 1 r * 1 J 


,A N ) is 


(are) n 


(4.2) 


It then follows from Lemma 3.1 and (3.7) that 
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? N (t) = (b 0 ,“‘,b N , a 0 ,«*»,a N _ 1 , n) T , t > 0 


satisfies 


- a" ? N (t) + b n »(t). 


(4.3) 


5 (0) = 5, 


N N N — 1 ~ isj 

where A = ft A (ft ) and 5 is the vector representation of Q 1N z in 

terms of Legendre coordinates. A**, are given in Section 3. Thus we 

can write (4.1) as 


Minimize J N (u,5) = / (Ic^ £ W (t)|^ + |u(t)| Z )dt 

0 


?N ?N,. ,,2 


(4.4) 


subject to (4.3), where C 1 ^ = C N (ft N ) - ^ with 


C N -( © |C| C|--- |C) E px2n(N+i>_ 

nx(N+l) 

Hence the optimal solution to (4.1) can be also given by 


A.).-(»V ^(t), 


where Z satisfies the matrix Riccati equation 


CA N ) T E N + I» A» - e n b n (b n ) t e n + (C N ) T c N = (D . 
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If (A N ,B) is stabilizable and (C,A N ) is detectable, then (4.5) has a unique, 
symmetric, non-negative definite solution and it can be computed effectively 
by Potter's method (e.g., [13], [11]) which involves the eigenvalue- 
eigenvector decomposition of the matrix 


A N -B N (B N ) T 


h n = 


(4.6) 


4 " w N t ~n 

-(cV c N 


~N T 

-(A) 


Let us define the matrix 


:n 


by 


;n ,n _n .n 

E = A E A 


where 


A N = diag(— j- ,••*, 


2k+l 


2N+1 


1 

— 


2k+l 


2N 


qr. 1). 


and define the matrices o. . , 0 < i,j < 2N+1 by 

i-* J 

°ij = ( e i+l © ^ ^ ^ e j+l © (4 * 7) 

where e* is the ith unit vector in i.e., e. = (0, ••• ,0,1 ,0* • »0)^. 

1 v_i-i y 

Lemma 4.1. Suppose (A N , B) is stabilizable and (C,A N ) is detectable. 
Then for z = (n ,<(> ) e Z, II N z = (y,t) with 
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- 0 1 M 

y - or\ + j i i a 9 k+N+1 ) P^ 1) (e)K0)d0 + / l (o k )P k 2) (0)<t>(0)d0, 
-0 k=0 * -r k=0 


0 N-l 

+ / I (®. 


and 


N-l 0 N-l 

K 6 ) - I [(° 1+N+1 ,> ♦ J l < 9H(6)d9 

i— 0 k— U 

~0 1 ^ 

+ 1 J n (“i + N + l,k)4 2><e) +< 9)d9 ] ! '" )(6) > < (-9 1> 0] 

-r k=0 1 


+ [(0 ±> .)n + / 0 J o ( a i,k+N+l )P k 1)(0)<l>(0)d0 


-0 

J I (., k ) P < 2 , ( 9 )* ce ) d 9 ] p < 2 >< 9 ) x 
-r k=0 1 » K K 1 1 * 1 J 


where the symbol (•) stands for 2N+1, a - °2n+1,2N+1* 


Proof: It is known [17] that 


a N z,z> 2 = <I N X, %> ^ n ( N+ i) - min J N (u) 


^ N N 

for all z e Z, where X is the vector representation of Q z. Since Z 

N 

and II are symmetric, 


™N 1 2 S ._N -jrl ?2 S 

<n z ,z > z = <Z K > ^ n (N+l) 


(4.8) 
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^ i i ~j[ 

for all z = (n ,4> ) e Z, 1 = 1,2, where 5 is the vector representation of 
Q N z* for i = 1,2. Note that 


>■. Nv-1 ~i _ , a i i i.T . _ . „ 


where for i = 1,2 


ef = I /(e) pi 2) (0)d0 


af = / <j> i (e) Pi 1) (9)d6 


(4.9) 


Then 


Y 1 = n 1 


,„N ~1 ~2. /n l 1 l s :n,„2 2 2.T 

<2 5 , £ > = (£ , a , y ) £ (£ , £ , Y ) • 


Now, if II N (r| 1 ,<J> 1 ) = (y,40, then 


0 —0 

<n N (n 1 ,4> 1 ),(n 2 ,<|) 2 )> 7 = <n 2 ,y> + / <<t> 2 (9),iKe)>d9 + / <<f> 2 (0), 

-0, -r 


Equating (4.8), we obtain 


■ onl + X KwwiK + Jo 


and 
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= i=o ^° i+N+1 >*^ n + £=0 ^ °i+N+l , k+N+ 1 ^ “k 


+ k £ 0 ( °i+N+l,k )B J P i ) X (-0 1 ,O] 


N . N-l . 

+ I [(«! > + l (°i k+N+lK 

1=0 ’ k=0 ’ K 


N 


+ J Q ^l.k^k^ P i 2> X [-r,-0 1 ] 


which completes the proof along with (4.9). 


(Q.E.D. ) 


Corollary 4.2. The optimal solution to (4.1) can be written in the 

operator form ; 

N, v r/N ~N, s 
u (t) = -K z (t)* 


K N e L(Z, IP) is given by 


k n Z = B T (n°° n + / n^°(0) T <K0)d0), for z = (n,<j>) e z, 

-r 


where 


and 


ttOO 

"h 


N-l 


H N ^ ~ i=o ^ ai+N+1 »*^ P i X (“ e 1 » 


0] 


N ti\ 

+ I [o Jp^ ; ( 0) Xr _ 0 v -r < 0 < 0, 
1=0 ’ 1 ’ 1 J 
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•ft «p 

Pyoof : Since 8 = B ti, the corollary follows from Lemma 4«1 and 

< 4 * 2 )* (Q. E. D.) 

Remark: For single point delay case, we are able to prove that if (A, 8) 
is stabilizable ((C,A) is detectable), then for sufficiently large N (A N ,8) 
is stabilizable ( ( C »A^) is detectable), which will be discussed in the 
forthcoming paper. The proof is based upon the characterization of 
detectability in Remark 2.2. 


5. CONVERGENCE PROOF 

In this section we discuss the convergence property of 11^. It is easy 
to show that for k > 2 

V k = P(A k ) c {(<|>(0),<f>) e Z | $(0) = / dy(0)<j>(0) and * e H k } , 

-r 

(5.1) 

and is dense in Z. Let us introduce the graph norm on p k ; 

k . j , 

»zl = l IIA zK for z e V . 

V i=0 L 

Note that H<J>H , < II zO , for all z = (<f>(0),<{>) e P k . 

H k V 

Theorem 5.1: _If_ {11^} is uniformly bounded on Z and (C»A) is 


detectable, then 
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N 

( i ) n converges weakly to n which is the unique solution to ARE, 

(ii) there exists an integer Nq such that if N > Nq, then 

HS N (t)l! < Me” UJt 

N 

for some positive constants M and ui, where {S (t), t > 0} is the 

semigroup on Z generated by A - 8(8^)* 11^. 

Proof of (i): Since {11^} is uniformly bounded on Z, by Theorem 6.5 in 

N. 

[8], there exists a subsequence {II which converges weakly to some non- 

negative, self-adjoint operator II. If (C »A) is detectable, then from 
Theorem 2.3, ARE has at most, one non-negative, self-adjoint solution. Hence, 
we only need to show II satisfies ARE. Without loss of generality we can 

assume that a converges weakly to II* Note that for N > 1, II satisfies 

(ARE) N . Since dim(R m ) < » B H converges strongly B II. It now 
follows from Lemma 5*2 that 

2<Az,nz> - <8* n z ,B* nz> + <Cz,Cz> = 0, (5.2) 

2 

for all z e p . 

Since V 2 = P(A 2 ) is dense in V(A), a simple limit argument shows that (5.2) 
holds for all z e P(A); i*e., II is a solution to ARE. 

Proof of (ii) : First of all, we note that A = A - BB* II generates a 

uniformly exponentially stable semigroup (S(t), t > 0} on Z; i.e., there 
exist positive constants M and w such that 
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n s(t) n < Me , t > o. 


(5.3) 


For z e 0(A) 


(A - BB* n N )z = Az - - 8(8* n - B* n N )z. 


Thus, 


S N (t) - S(t)z + / S(t-s) 8(8* n - B* n N ) S N (s)zds, 

0 

for all z e Z. 


(5.4) 


For t > r, we may write (5.4) as 


S N (t)z = S(t-r)z + / S(t-s) B (B* II - B* II N ) S N (s)zds, (5.5) 


with 


z = S(r)z + / S(r-s) B(8* n - 8* n N )S N (s)zds. 


(5.6) 


From [5] we have that S(r)z e V(A) for all z and HS(r)zll < y^ nzl, 2 ^ or 


some positive constant y^. If 


z(t) = (x(t),x(t+« )) = / S(t-s) 8u(s)ds, t > 0, 

0 


then x(t) e H*([-r,T]; if 1 ) for any T > 0 and satisfies 


It * (t> 


/ dli(0)x(t+0) - BB^ II ^ x(t) 


- BB T / n 1O (0) T x(t+0)d0 + Bu(t) 


= / dy(0) x(t+0) + Bu(t). 
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Hence for u e L 2 ° c ([0,<»); IP), z(t) ep(^) and 


~ ~ 0 

A / S(t-s) u(s)ds = (/ dy(6) x(t+9), ^(t+O), 

0 -r 


where 


♦ (t) = / dy(0) x(t+0) + Bu(t), t > 0, 


’l'(t) = 0 for t < 0. 


Here we note that 


1/ dyx(*+0)ll < Y nxll 

-r L 2 ( [a,b] , lR n ) L 2 ( [a-r,b] , ]R n ) 


(5.8) 


for b > a > 0, where y 2 = / |dy|. Since {n N } is uniformly bounded, it 

-r 

now follows from (5.6) and (5.7) that z e V(A ) for all z e Z and 


" ~ < V Z "z’ 

P (A ) J Z 


(5.9) 


for some positive constant y 3 * From (5.5) and (5.7), S N (t) z e qC\) > t > r 


for z e Z and 


AS l, (t)z = S(t-r)Az + ~ J S<t-s)8F N (AS N (x)z)ds, (5.10) 


where F W : Z -► 1? is given by 


F N = (B* n - B* n N )A _1 . 
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Since 0 i Po(A), (A) exists and moreover, it is compact [17]. Note that 

(F N )* = (A*)" 1 (IB - n N 8) e L( IP, Z). 

Since II 8 converges weakly to II 8 as N » and (A) is compact, 

(F N ) converges strongly to zero. Hence, the finite dimensionality of iP 
implies 

H(F N )*B = IIF N II ->-0 as N 

N 

i.e*, for any e > 0 there exists an integer Nq(g) such that II F II < e for 
N> N q . 

N 

For z e Z, let us define the Z-valued function B (t), t > r by 

N ~ N 

B (t) = A S W (t)z. 


Then from (5.7) and (5.10) 

„ „ _ 0 

B (t) = S(t-r)Az + ( / dp(0)x(t+0) , tp(t+» ) ) , 

-r 

where for t > 0 

t(t) - / dy(0)x(t+0) + 8F N B N (t) 

-r 

and 

(x(t),x(t+* )) = / S(t-s)8F N 3 N (s)ds, 
r 


t > r 


(5.11) 
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wit h x(t) = 0, t < r. Now from (5.8), for T > r 


(/ 

r 


( N (t)ll 2 dt) 1/2 < HAzll( / ns(t-r)ll 2 dt) 1/2 + Yo( / | x( t ) | 2 dt) 1/2 


T t 


+ Yo (/ / |x(s)| ds dt) 


1/2 


r t-2r 


T t 


+ |b| «f n ii (/ / n8 N (s)n 2 ds dt) 1/2 . 


r t-r 


and from (5.3) and (5.11), 


(M/(2m) 1/2 ) IIAzIl 


+ | B | HF N II Y 2 (l + (2r) 1/2 ) + (r) 1/2 )( / nB N (s)H 2 ds) 1/2 
w r 


where we used Fubini's theorem and Young's inequality. Thus, from (5.9) 


/ Hg N (t)ll 2 dt < (|-)y 3 Hz II 2 + 2 II F N II 2 Y 2 / H0 N (s)n 2 ds, 
r 0) r 


where 


Y = | B | (?y,(l + (2r) 1/2 ) + (r) 1/2 ) . 


0 ) 


2 2 

If we choose e such that 2e y < 1/2, then it follows that for T > r 


/ T »e N (t)n 2 dt < 2 (^-)y 2 nzn 2 . 

® r a) 


Note that S^(t)z = A A 3 l, (t) , t > r and A 1 e L(Z). 


■1 «N 


1 


Hence, for T > r 
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/ T iis N (t)zH 2 dt < 2(|-)y 2 IIA ^i 2 Hzii 2 . 
r a) 

It now follows from Lemma 7.4 in [8] that there exists positive constant M 

and 03 such that 

ns N (t)ll < Me" 0 *, t > 0 for N > N Q (e). (Q.E.D.) 

Lemma 5.2. II (A^ - A)zll 0 as_ N 00 

for all z e 1?^, k > 2. 


To prove this lemma, we need the following technical lemma. 


Lemma 5.3. Let us define the projection operator £f_ L 2 [ — 1 » 1 ] by 


N 


N c 

P f = l f t P, 


k=0 


k k 


f, = 2k t 1 / f(x) P, (x)dx. 


k 2 


-1 


Then for any positive integer m, there exists a constant K such that 


|P N f(±l) - f (±1) I < kn~® + 1/2 Ilf II 


H 


m 



(P N f)(±l) - £| < Klf® + 5/2 


Ilf II . 

„m 


and 
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Proof: Note that for k > 1, satisfies 

LP k + k(k+l)P k = 0, 


where is the differential operator: 


(LfXx) =^((1 -x 2 ) ^f). 


Thus for k > 1 


and 


f £ H 


1 


2k+l 

*k “ “ 2k(k+l) 


1 

/ 

-1 


f(x) LP k dx = 


2k+l 

2k(k+l) 


1 

/ 

-1 


(1 - x 2 ) 4— P, 4- fdx. 
dx k dx 


Using the relation 


< 1 ' * 2 > k P k 


k(k+l) 

2k+l 




(5.12) 


we obtain 


f k 2 ( P k+1 " P k-1^ dx fdx * 


It then follows that 


N 


1 


(P N f)(±l) = 1 (±l) k a k = a Q + (j l ±j l )/ (P, 

k=0 k:even k:odd -1 


k+1 


p k -l)fdx. 


If N is even, then 


T 
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. i ,1 

(P f)(±l) = a Q (Pi ± P 0 )fdx + j I (P N+1 ± P N )fdx 

1 1 1 1 .1 1 

= J J fdx “ J I (x ± Dfdx + j (P N+1 ± P N )fdx 

. 1 

= f(±l) + ±! (P N+1 ± P N )fdx. (5.13) 


Similarly, for N odd, 


(P N f)(±l) f(±l) +j J (P N ± P N+1 )fdx. 


(5.14) 


If m = 2k+l, k > 0, then 


/j P N fdx (- (L P N > ^ dx (” n(N+1)^ ^ P N^ L ^ dx * 


1 

r 

-l 


And, if m = 2k+2, k > 0, then 


P N ■ (- NfW) k+l £ 4 e p k ^ h-K 

and using (5.12) 

N(N+l)^ 2N+T ^ P N+1 “ P N-1 ^ dx ^ ^ dx * 


Since 1^ is a differentiable operator of order 2k with polynomials, 
coefficients on [-1,1], there exists a constant c^ for k > 0 such that 
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,tk f ' <<* ,f ' 2 k+1 
H. 

and 

.|j (L k f)« < ^ 

rl 

Now, the first inequality of the lemma follows from (5.13) and (5.14). 
To prove the second inequality, we note that 


d_ 

dx 


(P N f)(±l) = l (+l) k - k - ( - k y 1} a 
k=0 L 


1 N 1 

T 1 (+1) / (*-f)P. dx. 

k=0 -1 K 


Then the same arguments as above enable us to obtain the second inequality. 

(Q.E.D. ) 


Proof of Lemma 4.2: From the definition (3.7) of L N 


where 


N t N 
2 = L z 


(* N (0),t N ) 


4> N - ♦ 


(l) 


X (-9 1 ,0] 


+ <f> 


( 2 ) 


X [-r,-9 1 ]’ 


♦ (1) " l \ p k° on (-0 ,0], 

k=0 K K 1 

* (2) - I b k P< 2 > on t-r,-e ] 

k=0 K 1 


and {a^} and {b^} are given by (3.8) - (3.10). It then follows from (3.4) 
and (3.6) that 
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wit h 


,N , N . N> 
A z = (n , ^ ) 


n N = / dy (0 ) 4 > n 

-r 


* N 'i (1) X(- 6l , 0 ] + * (2) x t-r 1> -e 1 ) 


, r .(l), fl s .(2), g ^ ? IktL p(2) Y 

+ (♦ (-ep - <J> ( e 1 )J l a 2 p k x hrr0i ] 


Thus, for z e P(A) 


6 = n (A N - A)zii < i j 


(l)' 


L 2 [-0 1# O] 


+ li 4> 


( 2 ) 


^[-r.-Oj 


+ |<f> u; (-0,) - I a 

1 1 k=0 2 


N 


2k+lU/2 


)• 


+ |J dy (9)(4 > n ( 0) - <|>(e))l 


-r 


= «1 + 6 2 + 63 + « 4 . 


Here, we note that 


^(D = + (4,(0) - ^(O))?^ on [-0J ,0] , 


? (1) - a k p£ U on [— 6 x * 0] * 

k=0 R K 


(5.15) 


(5.16) 


where 
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For z = (♦(0) f +) e V(A), 

0 XT 

/ dy (0 )(<!> (9 ) - 4,(6)) 

-r 

" A 1 (+ (1) (-0 1 ) - K-ep) + A 2 (<J, (2) (-r) - K-r)) 

0 —0 
+ / A(0)(? (1) - 4>)d0 + / 1 A(0)O (2) - , 

“ 9 1 

where from (5.16) 

4 > ( 1 ) (-e 1 ) = ? ( 1 ) (-e 1 ) + (±D N (? ( 1 ) (0) - <K0)). 

It then follows that 


5 4 < |A X | (|? (1) (-9 1 )-<{>(-0 1 )| + |? (1) (0)-<K0)|) + |A 2 | |4. C2) (-r)-4>(-ir) | 
+ ,a( - ), l 2 C* a) ^ , L 2 [-9 1> 0) + , » <2) -+' L2( . r> .e il ). 


It now follows from Lemma 5.3 and Lemmas 3.1 — 3.2 in [9] that 


l« 4 l < K (<2|A 1 | + |A 2 |)N _k + 1/2 + 2 HA(.)" l N~ k ) 


< K, N -k+ ^ 


From Lemma 3.2 in [9] 
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5, < K, (f k+ 3/2 II z II . 
2 2 £> k 


From (5.16) 


:<D 


S 1 ♦ , L 2 [-9 1 ,0] + 


/N(N+1) K? (1) (0) 


where we used the fact that 


/ |P (0) | 2 d0 = N(N+1). 
-1 


It then follows from Lemma 5*3 and Lemma 3.2 in [9] that 


Sj < K x N -k+ 3 ^ 2 II z II 


r 


Since 


|4> (1> (-e 1 ) - ♦^■(-0 1 )| 


(2), 


< |<t' (1) (“0 1 ) - -K-epI + |<f> ( 2 ) (-Q 1 ) - 4> (—0 x ) | 

< |? (1) (-e 1 ) - 4>(-e 1 ) | + |$ (1) (0) - <K0)| + \i 


it follows from Lemma 5.3 that 


6, < K, N“ k+ 3 II zl! . 
3 3 V k 


- <K0)| 


(2) ( _ 0i ) _ K-epl, 
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Hence from (5.15) 


«(A N - a) Zll < K *f k+ 3/2 llzll k > 2, 

where K is independent of N. (Q.E.D.) 

% 

N 

The next lemma concerns the uniform boundedness of (II } in Theorem 5.1 

(i). 


Lemma 5.4. Consider the system with the form 


a 1 

“tt" x( t ) = \ A. x(t - 9.) + Bu(t) . (5.17) 

dt i=0 

If the pair (Aq,B) is controllable and the range of B contains the range 
of A^, 1 < i < £, then {11^} is a uniformly bounded sequence on Z. 

Proof: For simplicity of exposition we consider the case, Z = 2. The 

approximate solution z^(t) = (z^(t,0), z^(t,*)) e Z of initial value problem 
(5.17) satisfies 

z N (t,0) = A q z N (t,0) + Aj z N (t,(-0 1 ) + ) + A 2 z N (t,-r) + Bu(t), 

(5.18) 

z N (t,0) z N (t,0) -r < 0 < 0 


where the second equation holds in the sense of (3.3). Since (Aq,B) is 
controllable, then there exists an m*n matrix K such that the matrix 
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(Aq-BK) has distinct negative real eigenvalues X^, 1 < i < n with 

max X. < -3/2. Since the eigenvalues of (Aa-BK) are distinct, there 
l<i<n 

exists a nonsingular matrix P such that 


P _1 (A 0 - BK)P - A - diag(X 1 ,-*,X n ), 


Let us consider the feedback control low to (4.1): 


u(t) = -Kz N (t,0) - (B T B) _1 B T (Aj z N (t,(-0 1 ) + ) + A 2 z N (t 1 , -r)). (5.19) 


Then (5, 18) has the closed loop equation; 


^-z N (t,0) = (A Q - BK)z N (t,0), 


It zN(t * e) m h zN(t » 0) ' 


(5.20) 


If z N (t) = (p ^ z^(t,0), P ^ z^(t,*))» t > 0, then z n (») satisfies 


z N (t,0) = Az N (t,0) 


8 A N _ 3 A N 

3t z W Z * 


By using the same arguments given in the proof of Lemma 3.1, we obtain 
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IZt “ Q N ^ (t) "g 41 <A ^ t * 0) » 2 N (t,0)> + |z N (t,0) | 


-i bVc-epT -^|z w (t,-r)| 


+^2 1 i A N/ 


-I(h N (t,o)| 2 + h N (t 1 (-e 1 ) + | 2 + |z^(t,-r) | 2 ), 


where we used the fact that A < - -j I. Integration of this with respect 
to t yields 


1 Q N ; N ( t ). 2 -« q n ?( o ). 2 

§ s 


< - j’(|z N (s,0)| 2 + |z N (s,(-e ) + )| Z + |z W (s,-r)| Z )ds, 
0 


v+m2 . N, 


for all t > 0. Thus, for all t > 0 


f |z N (s ,0) | 2 ds, / fc |z N (s,(-0 ) + )| 2 ds, 

yv ■“ 


/ t |z N (s,-r) | 2 ds < kq n z N (o)n 2 < iizn 2 < O (p- T p" 1 ) yzo 2 

11 § ul3X 5 


Since H zll 2 < 211 zll^, it now follows from (5.9) and (5.20) 


<n N z,z> < J N (u,z) = / (|Cz N (t,0)| 2 + |u(t) | 2 )dt < 3 Izi: 


for some positive constant 6. Since II is nonnegative, self-adjoint, for 


N > 1, IT < 61. 


(Q.E.D. ) 



6. NUMERICAL EXAMPLES AND CONCLUSIONS 


In this section, we discuss some numerical examples which demonstrate the 

feasibility of the Legendre-tau method for approximating the optimal feedback 

solution. We only consider examples of optimal control on the infinite 

N 

interval. We solved the Riccati equation (4.5) for the matrix E using 

Potter's method. All computations were performed using MATLAB developed by 
Cleve Moler [12] which provides easy access to matrix software developed by 
UNPACK and EISPACK projects. 

The Nth feedback control is given by 

u N (t) = -B T (n°° x(t) + / n*° ( 0 ) T x(t + 6)d0), (6.1) 

— r 

where and II ^ are given in terms of the coefficients of in 

Corollary 4.2. The strong convergence of to II implies 11^ + II ^ and 
nj° * II ^ in I^d-r^O]; H^ 1 * 11 ). We also discuss below how closely 11^ and 
II* 0 approximate the conditions described in Theorem 2.5 and how closely the 
eigenvalues of the Nth Hamiltonian matrix in (4.6) approximate the closed- 
loop eigenvalues of A - BB* II. 

Example 6.1. (Gibson [8], Example 8.1) 

Consider the scalar differential equation 

4r" x(t) = x(t) + x(t-l) + u(t), (6.2) 


and the performance index of (2.6) is 
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j(u,(n, < | ) )) = / (x 2 (t) + u 2 (t))dt. 
0 


(6.3) 


Of) lf)T 

For each N, 11^ is a scalar and 11^ (•) e ( [—1 *0 ] ; R) and B = 1 in 
(6.1). Table I shows the numerical results for II ^ and the expansion 

coefficients of i.e., 


n 


10 

N 


( 0 ) 


N-l N 

l \ P k (26 + 1), 


-1 < 0 < 0 , 


and how closely we have approximated the boundary condition (2.14). 


Table I 



N 

2 

4 

6 

8 


n 00 

N 

2.8139 

2.8094 

2.8094 

2.8094 


k=0 

1.4222 

1.4267 

1.4267 

1.4267 


1 

-1.0844 

-1.0438 

-1.0438 

-1.0438 


2 


0.2919 

0.2919 

0.2919 


3 


-0.0424 

-0.0420 

-0.0420 

r N, 

{a k } 

4 



0.0046 

0.0046 


5 



-0.0004 

-0.0004 


6 




2.3 x 10“ 5 


7 




1.2 x 10” 6 

In 00 - 

1 N 

"JV 1 ’! 

0.3074 

0.0046 

2.3 x 10 -5 

5.3 x 10“ 8 
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For comparison, the following are obtained using the average (AVE) scheme 
[8] and the linear spline (SPL) scheme [4]. 


n^r(AVE) = 2.8130 
n°°(SPL) = 2.8091. 


Note that both schemes have not fully converged yet. However, for the 
Legendre-tau method, the result for N = 4 appears to give a fairly good 
approximation of the optimal feedback; e.g. , 


|n°° - n°°| = 4.4 x 10 - 7 , 


"i 0 -*iVi.o] - *- 5 * io ' 3 - 


Table II compares JI^®(0)(AVE) and II^(0)(L-T) where L-T denotes the 


Legendre-tau approximation 
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Table II 


linj°(0) (AVE) 

- nf°(e) (L-T)I = 
U 2 

1.9 x l(f 2 

e 

n 64 (0) < AVE ) 

n*°(e) (L-T) 

0.0 

0.6435 

0.6323 

-0.1 

0.7273 

0.7225 

-0.2 

0.8258 

0.8273 

-0.3 

0.9607 

0.9519 

-0.4 

1.1023 

1.1013 

-0.5 

1.2694 

1.2807 

-0.6 

1.4965 

1.4951 

-0.7 

1.7315 

1.7497 

-0.8 

2.0480 

2.0494 

-0.9 

2.3748 

2.3994 

-1.0 

2.7541 

2.8048 


The oscillatory behavior exhibited by the spline approximation to II ^ 
[4] has not been observed for the Legendre-tau approximation. 

Table III shows the eigenvalues A^ of which give the relatively 

A M A 

small equation error |det A(X^)| where A(X) is given by (2.5); i.e., in 
this example 

A(X) = (X - 1 - e" X )(X + 1 + e X ) - 1. 

In the table, the numbers inside ( ) stand for the corresponding equation 
errors |det A (X ) | to the eigenvalues X^. 


i 
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Table III 



N 

2 

4 


1=1 

-1.4032 

-1.4011 



(.019) 

(1.9 x 10“ 6 ) 

{xj} 





2 


-1.6351 ± 4.1627 




(.38) 



N 

6 

8 


iH 

II 

-1.4011 
(3.2 x 10 -11 ) 

-1.4011 
(2.4 x 10“ 15 ) 


i=2 

-1.6343 ± 4.1827 
(8.2 x 10“ 4 ) 

-1.8343 ± 4.1827 
(4.5 x 10" 7 ) 


1=3 


-2.4284 ± 10.6698 




(2.3) 


N 16 

1=1 -1.4011 

(1.2 x 10” 14 ) 

1=2 -1.6344 ± 4.1827 

(6.7 x 10" 1A ) 

1=3 -2.4256 ± 10.6890 

(2.1 x 10” 10 ) 

-3.1695 ± 23.3811 
(4.5 x 10" 4 ) 


1=4 
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Example 6.2. (Gibson [8], Example 8.'3) 

We consider the problem of minimizing 


J(u) = / (y (t) + y (t) + u 2 (t))dt, 
0 


(6.4) 


subject to the harmonic oscillator with delayed restoring force and delayed 
damping given by 

d 2 A 

— o’ y(t) + -T- y(t-l) + y(t - 1) = u(t). (6.5) 

dt z az 

If we define x(t) e 1? by 

x(t) = (y(t), y(t)) T , 


then (6.4) and (6.5) are equivalent to 


j(u;(n,<|>)) = / (|x(t)| 2 + u 2 (t))dt 
0 


and 


k x(t) ■ [° o] X<t, + [-I -il 


respectively. 

The optimal control in feedback form is 


u(t) - n^ 21 Xl (t) - n^ 22 x 2 (t) 


- J ( n ^2 (0) x l (t + 0 ) + n ^22 (0) x 2 (t + 0) ) d0 


( 6 . 6 ) 
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r 10 


T oo 


where II ^ . and II .(6) are the (i, j )-elements of the matrix II and 

r 10 


H (0), respectively. The Nth feedback control law is 


U s (t) = - n°° 21 ,,(«) - i» ' x 2 (t) 


- J (lj°i2 <0) x l (t + «> + n !i“22 <6) x 2 (t + 9) ) d9 ' 

Note that if we define £(t) e IE? by 


,10 


(6.7) 


£(t) = (y(t) , ^ y(t) + y(t)) T , 


then (6.4) and (6.5) are equivalent to 


j(u; (n,?)) = J (C(t) T Q 5(t) + u (t))dt, 
0 


( 6 . 8 ) 


with 


Q = 


2 

-1 


-1 

1 


and 


'-i r 


o 

o 


1 

o 


, S(t) + 


, 5(t - 1) + 


-i i 


1 

0 

1 

J— • 

1 


i l \ 


3F {(t) 


respectively. Here, the initial conditions 


u(t ) , (6.9) 


n = (0.0) 1 and 5 2 (9) = 0, 


-1 < 0 < 0 , 


( 6 . 10 ) 
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yield ?(t) = 0, t > 0, regardless of the initial function 5^(0), -1 < 9 < 0. 
Hence, for the initial conditions in (6.10) and any initial history 
the optimal control is u(t) = 0, t > 0. Therefore, the optimal control 
u(t) must have the form 


u(t 


) = " ^21 5 l (t) " 5 2 (t) " / ^22 (0) C l (t + 0)d0 ‘ (6 * U) 


where II corresponds to the minimization problem to (6.8) and (6.9). 

Note that ^(t) = x j(t) + X 2 (t), t > 1. Hence, it follows from (6.6) 


and (6.11) that 


n 10 = n 10 

,12 , 22 * 


Similarly, 


n 


10 


= n 


10 


N,12 N,22 ’ 


N > 1. 


Numerically, we have the results in Table IV 
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Table IV 


n 00 = 
2 

'2. 1407 
1.2988 

1.2988' 

1.8611 


n°° = 

4 

'2.1387 

1.2963 

1.2963 

1.8579 


II 

o 

O VO 
i=: 

2.1387 

1.2963 

1.2963 

1.8579 


ii 

o 

O 00 
K 

2.1387 

1.2963 

1.2963 

1.8579 


N 

2 


4 


6 


8 

k=0 

-0.8846 


-0.8821 


-0.8821 

-01.8821 

1 

0.8971 


0.8969 


0.8969 

0.8969 

2 



-0.0835 


-0.0835 

-0.0835 

3 



-0.0031 


-0.0030 

-0.0030 

<\> 4 



0.0014 


0.0014 



5 





-0.0001 

-0.0001 

6 






2.i 

► x 10" 6 

7 






2.i 

> x 10" 7 

|n^°(0) - aJ n°°| 0.2182 


0.0024 

1.3 x 10 5 

3.! 

* x 10 -8 


N-l 


N x 10 

In the Table IV, {a,} are the expansion coefficients of IL*. 19 (0); 


i.e. , 


k=0 


N, 12 


-1 < 0 < 0 . 


Note that 


i*? - "S° 


| = 6.3 x 10 


-7 


9 
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II IT 10 ttIO 

4,12 " n 8,12"L, 


= 4.8 x 10 


-4 


Again, one can see that the 
approximation. For comparison, 
schemes : 


n 


oo 

22 


2.1034 

1.2574 


result for N = 4 gives a fairly good 
the following are obtained by AVE and SPLINE 


1.2574' 

1.8123 


(AVE) 


n 


oo 

16 


2.1389 

1.2963 


1.2963 

1.8576 


(SPL) 


r 10 


Table V compares n 22,l,2 (0)(AVE) > C [8] , p. 137) and 2 (9)(L-T). 


Table V 


" I 22,1, 2 (9)<AVE) - "M,2 (9)a - T), L 2 ' 

7.0 x io“ 2 

9 

n‘“i >2 ( 9 )(AVE) 

n M,2 W(I - T) 

0.0 

-0.1152 

-0.0719 

-0.1 

-0.2247 

-0.2033 

-0.2 

-0.3449 

-0.3462 

-0.3 

-0.4750 

-0.5003 

-0.4 

-0.6147 

-0.6652 

-0.5 

-0.7631 

-0.8404 

-0.6 

-1.0013 

-1.0257 

-0.7 

-1.1698 

-1.2206 

-0.8 

-1.3455 

-1.4247 

-0.9 

-1.5278 

-1.6378 

-1.0 

-1.7160 

-1.8593 
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£ 

In this example, the closed-loop eigenvalues of A - 88 n are roots of 

a 

the characteristic equation det A(A) = 0, where 



Table VI lists the eigenvalues of which lie in the left half plane 

i A N i 

of C and give the relatively small equation error |det A(X^)|. 
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Table VI 



N 

2 

4 


i=l 

1.3983 

-1.3893 



(.0342) 

(3.3 x 10" 6 ) 


CM 

II 

•H 

-0.7358 ± 1.22071 
(.0277) 

-0.7339 ± 1.22351 
(3.4 x 10 -6 ) 



N 

6 

8 

{x»> 

i=l 

-1.3893 
(5.4 x 10 -11 ) 

-1.3893 
(3.9 x 10" 14 ) 


i=2 

-0.7339 ± 1.22351 

(6.2 x 10" U ) 

-0.7339 ± 1.22351 

(2.1 x 10“ 14 ) 


i=3 

-2.0927 ± 7.43951 

-2.0890 ± 7.4619 



(78.1) 

(.474) 


Example 6.3 Here we deal with the equation which has multiple point delays 


■^-x(t) = x(t ) + 2x(t-l) + x(t-2) + u(t), 


( 6 . 12 ) 


with the cost functional 

00 

= / (x 2 (t) + u 2 (t))dt. 

0 
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For each N, the Nth feedback control law is 


At) = - n°° x(t) - n^°(e) x(t+0)de. 


where II ^ is a scalar and Il* u (») e L.^C [ — 2 * 0] ; R) is given by 


,10 


n N 0<6) * j 0 b k »k (2e * 3 > X[-2,-l] <9> + X °k V 26 + ” *C-1, 


0 

-2 < 0 


Table VII shows the numerical results for II ^ and 11^(0) 

closely we have approximated the jump condition (2.13) and the 
condition (2.14) 


( 0 ), 

< 0 . 

and how 
boundary 
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Table VII 


N 

2 

4 

6 

8 

n 00 

N 

3.2159 

3.2074 

3.2073 

3.2074 

b 0 

1.5306 

1.5246 

1.5244 

1.5243 

b l 

- 1.220 

- 1.2205 

- 1.2214 

- 1.2216 

b 2 

0.3295 

0.3990 

0.3972 

0.3969 

b 3 


- 0.0583 

- 0.0590 

- 0.0595 

b 4 


- 0.0002 

- 0.0050 

- 0.0049 

b 5 



- 0.0008 

- 0.0001 

b 6 



- 0.0011 

- 0.0001 

b 7 




- 0.0005 

b 8 




- 0.0002 

a 0 

3.3767 

3.3911 

3.3914 

3.3914 

a l 

- 2.8081 

- 2.6999 

- 2.7004 

- 2.7006 

a 2 


0.8479 

0.8477 

0.8478 

a 3 


- 0.1119 

- 0.1092 

- 0.1094 

a 4 



0.0083 

0.0080 

a 5 



- 0.0018 

- 0.0009 

a 6 




- 0.0002 

a 7 




0.0004 

l<°(-2) -nj°| 

0.1352 

0.0047 

6.0 x 10" 4 

6.2 x 10” 5 



2.0 x 10 4 8.7 x 10 ' 


0.8865 


0.0090 
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We have the function values of 


*J°( 0 > 


in Table VIII. 


Table VIII 


6 

n^Ce) 

n |°( 0 ) 

nj °( e ) 

ng °( 0 ) 

- 2.0 

3.0807 

3.2026 

3.2067 

3.2074 

- 1.9 

2.6586 

2.6892 

2.6879 

2.6877 

- 1.8 

2.2761 

2.2518 

2.2492 

2.2498 

- 1.7 

1.9331 

1.8834 

1.8830 

1.8831 

- 1.6 

1.6297 

1.5769 

1.5769 

1.5784 

- 1.5 

1.3658 

1.3252 

1.3280 

1.3277 

- 1.4 

1.1415 

1.1213 

1.1229 

1.1233 

- 1.3 

0.9567 

0.9583 

0.9574 

0.9581 

- 1.2 

0.8114 

0.8292 

0.8266 

0.8265 

- 1.0 

0.6396 

0.6451 

0.6443 

0.6440 

- 1.0 

6.1848 

7.0508 

7.0587 

7.0587 

- 0.9 

5.6232 

5.9500 

5.9477 

5.9482 

- 0.8 

5.0615 

5.0047 

5.0025 

5.0031 

- 0.7 

4.4999 

4.2014 

4.2026 

4.2025 

- 0.6 

3.9383 

3.5267 

3.5303 

3.5298 

- 0.5 

3.3767 

2.9671 

2.9706 

2.9704 

- 0.4 

2.8150 

2.5094 

2.5103 

2.5106 

- 0.3 

2.2534 

2.1399 

2.1375 

2.1378 

- 0.2 

1.6918 

1.8454 

1.8413 

1.8411 

- 0.1 

1.1301 

1.6123 

1.6111 

1.6107 

0.0 

0.5685 

1.4272 

1.4360 

1.4362 





-59- 


In this example, the closed loop characteristic equation is given by 


A(X) = (X - 1 - 2e" X - e" 2X )(X + 1 + 2e X + e 2X ) -1=0. 


Table IX shows the eigenvalues of 


H 


N 


in the same manner as before. 
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Table IX 


N 

2 

4 

X? 

-1.5217 

-1.5174 

1 

(.2172) 

(3.0 x 10" 5 ) 

X N 

A 2 

0.9524 ± 2.4826 i 

-0.9028 ± 2.5445 i 


(2.090) 

(.0031) 

X N 

A 3 


-0.6103 ± 5.0272 i 
(.8349) 


N 

6 


8 


X N 

A 1 

-1.5174 


-1.5174 


(6.9 x 10 -10 ) 


(6.0 x 10” 14 ) 



-0.9029 ± 2.5445 

i 

-0.9029 ± 2.5445 

i 

z 

• 

o 

X 

o 

1 


(4.6 x 10" 11 ) 


x N 

A 3 

-0.5890 ± 5.0114 
(.0030) 

i 

-0.5889 ± 5.0114 
(2.7 x 10" 6 ) 

i 

X N 

4 

-1.3588 ± 8.7500 

i 

-1.3159 ± 8.7703 

i 


(10.18) 


(0.1018) 



X 


N 

5 


-1.0595 ± 1 1 .4781 i 
(4.108) 
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The numerical results presented here reveal that numerically one has 

N 

strong convergence of II for the Legendre-tau approximation. At this time, 
we hve not been able to prove the strong convergence of n N in the general 
case (except for certain special cases described in Lemma 5.4). It requires a 
careful study of the asymptotic behavior of the spectra of However, the 
efficiency of the numerical schemes is most important from the practical point 
of veiw. We observe, from the numerical results of this section, that the 
Legendre-tau method provides faster convergence and better approximation at 
low orders (i.e., small N) than the AVE and SPLINE schemes. In the above 
examples, the results corresponding to N = 4 give a fairly good 
approximation of the optimal feedback gain* 

As further evidence of the usefulness of the Legendre-tau approximation, 
one can use it as an approximation technique for computing closed-loop 
eigenvalues of the feedback system* Note that eigenvalues close to the origin 
are approximated quite well at low orders on the above examples* 

From these observations, we believe the Legendre-tau approximation scheme 
offers one of the favorable methods for construction of feedback gains* In 
future investigations, our efforts for constructing feedback gains for delay 
systems will be combined with the approach to finite-order corapensentor design 
for distributed parameter systems [15], developed by J. M. Schumacher to 
develop a design procedure for the construction of corapensentors for delay 


systems. 
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